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ABSTRACT 



This document contains two papers related to the 1993-94 
Schools and Staffing Survey (SASS) . The first paper documents some of the 
problems that were encountered during student sample selection and the 
methods used to resolve those problems. It also provides some suggestions to 
alleviate some of the problems in future SASS studies. Significant problems 
were: (1) missing sampling data; (2) schools that would not cooperate; (3) 

problems with the instructions; (4) duplicate students; (5) timing problems; 
(6) matching problems; (7) omitted numbers of classes students took; and (8) 
teachers incorrectly identified as ineligible. The second paper explores 
options for using information from the Private School Survey (PSS) to ratio 
adjust the SASS to achieve agreement between the two surveys. Two broad 
classes of solutions are discussed. The first involved extrapolation from 
previous enumerations of the PSS to produce estimates, and the second 
involved interpolation between the 1997-98 PSS and preliminary information 
for the 1999-2000 PSS. Five attachments describe extrapolated values and 
estimated values for the 1995-96 list frame. (SLD) 
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Part One: 1993-94 SASS Student Sampling Problems 



I. INTRODUCTION 

The 1993-94 school year was the first time the Student Records Survey was included as 
part of the Schools and Staffing Survey (SASS). This memorandum documents some of 
the problems we encountered during student sample selection, the methods used to 
resolve these problems, and provides some suggestions to alleviate some of the 
problems in future enumerations. 



II. BACKGROUND 

For the 1993-94 SASS, about 13,000 schools, 67,000 teachers, 7,600 libraries and 

librarians, and 6,900 students were selected 1 as follows: 

• Private and public sample schools were selected first. 

• All principals from SASS sample schools were in sample for the School 
Administrator Survey, 

• A sample of teachers was selected within each of the SASS sample schools for 
the Teacher Survey, 

• A subsample of SASS sample schools was selected for the Library and 
Librarian Surveys, 

• A subsample of SASS sample schools and teachers was selected for the Student 
Record Survey. 

Students were selected for sample through a complicated procedure. From the teachers 

selected within SASS subsampled schools, three teachers were subsampled per school, 

one class period per teacher, and two students per class period as follows: 

• During the selection of the sample for the SASS School Survey, we selected a 
subsample of the SASS public, BIA, and private sample schools to participate in 
the Student Records Survey. A total of 1,751 schools (1,370 public and 381 
private) was selected for the subsample. 



‘Kaufman et al., 1993-94 Schools and Staffing Survey: Sample Design and Estimation, U. S. Department of 
Education, Office of Educational Research and Improvement, October 1996. 
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• From each of the student subsample schools, we selected a subsample of three 
of the school’s sample teachers. If a school had fewer than three sample 
teachers, we kept whatever number they had. 

• For each of the school’s sample teachers, we selected a class period as follows: 

1) We selected five sample class periods from all of the class periods at the 
school. 

2) For each of the three sample teachers, we determined if the teacher 
taught an eligible class during one of the selected periods. 

3) If a sample teacher had no eligible class during any of the school’s five 
sample periods, we selected five more sample periods. We continued 
selecting five class periods until at least one eligible sample class period 
was identified for each of the three teachers. 

4) Of the periods identified as eligible for a sample teacher, we selected 
one class period. 

• We requested the roster of students for the selected class period and selected 
two students from the class roster of the selected period for each of the school’s 
sample teachers. 

A member of the school’s staff completed questionnaires for each sample student (six 

students per school), using information from the student’s administrative record. 



m. PROBLEMS ENCOUNTERED DURING STUDENT SAMPLE SELECTION 

Many problems were encountered during the student sample selection process, and 
many lessons were learned. Sections A-H below describe some of the problems that 
arose. We also explain how the problems were resolved. 

A. Missing Sampling Data 

Some sampling data we needed to accurately process student records through 
the weighting procedure was missing from a large number of student records. 
We resolved this problem by several means: 

1 . Some of the data which was missing on the file had actually been 

reported and were available on student sampling worksheets. The data 
either had not been keyed or had been keyed incorrectly. 
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2. In a few cases where a student’s record had missing data, the student 
was taught by the same teacher or was from the same school as another 
sample student whose record contained the data we needed. In these 
instances, we copied the appropriate data from one student’s records to 
the other. 

3. As a last resort, we filled the missing fields through an imputation 
procedure. Imputation rates are provided in Section IV. 

B. Schools Refused to Cooperate with Sampling 

Many schools were reluctant to provide student names and the associated 
information over the telephone. To get interviews in these cases, personal visits 
were made to the schools by Census Bureau Staff from regional offices. 

Because of the expense, some of the schools (such as those located in remote 
parts of Alaska and in some areas of California) could not be visited. For these 
schools, an additional attempt was made to obtain the interviews by telephone. 

The number of personal visits made by type of school are: 



Public 


189 


Private 


83 


BIA 


16 


School nonresponse rates are 


provided in Section IV. 



C. Problems with the Sampling Instructions 

The sampling instructions may have been too complicated or too time 
consuming to be understood and completed by telephone. For example, it was 
possible for a respondent school to go through three different sets of class 
periods for all three of its sample teachers to identify one eligible class period 
per teacher. 

The instructions for selecting sample class periods were difficult to apply in 
schools with unusual schedules. We also suspect that some respondent schools 
did not follow our sampling instructions since there were unrealistic values for 
some variables on many student records. 

D. Duplicate Students 

If a student was selected for more than one of a school’s sample teachers, 
instructions were for the interviewer to place an ‘M’, to denote ‘MULTIPLE’, 
in a field on the student sampling worksheet. We discovered that this data had 
been entered on the worksheet per instruction in many cases, however, the 
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F. 



G. 



information had not been transferred from the worksheet to the file during the 
keying operation. We were forced to identify duplicate student records through 
a tedious clerical operation. 

The number of students selected more than once by type of school were: 



Timing Problems 

Some school schedules conflicted with our sampling schedule. Census Bureau 
personnel in Jeffersonville had difficulty contacting some schools because the 
schools were closed for holidays or vacation during the time period we 
designated for sampling. Jeffersonville personnel began making calls to the 
schools January 3, 1994, and completed the calls on February 14, 1994. 

Teachers Did Not Match School 

In a few cases, a school was called and information was requested for a 
particular teacher, but the teacher was not employed by the school that had been 
telephoned. After investigating, it was found that the teacher actually taught at a 
different school and that the mix-ups were between private and public schools 
with similar names. The teachers we were trying to locate were usually public 
school teachers, but the telephone numbers we had called were for the private 
schools. 

Number of Classes Students Took Was Not Asked 

To correctly determine a student’s probability of selection, it is necessary to 
know how many classes a sample student was taking. The number of classes a 
student was taking was not asked, and because it was not known, the student 
probability of selection was computed with the assumption that all students in a 
school took the same number of classes. This made the student weights biased. 

Teachers Incorrectly Classified as Ineligible 

During the student sampling procedure, some of the teachers selected for the 
student subsample were incorrectly classified as ineligible (i.e., not teachers) by 
Census Bureau staff in Jeffersonville. The misclassified teachers included 
teachers such as those that teach only one class (like band class) and special 
reading teachers who teach selected students in different schools. 



Public 

Private 

BIA 



26 

12 

5 
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Because these teachers were misclassified as ineligible, no sample students were 
selected from them. These misclassified teachers were accounted for during the 
student weighting procedure with the misclassified teachers adjustment factor. 

The number of teachers incorrectly classified as ineligible by the staff in 
Jeffersonville were: 

Public 117 

Private 18 

BIA 16 

The proportion of teachers classified as out-of-scope are provided in Section IV. 



IV. FREQUENCY COUNTS FOR THE STUDENT SAMPLING PROBLEMS 

A. Response Rates for the SASS Student Survey by Type of School 



The response rates in tables 1 and 2 below show what proportion of student 
records were considered complete. For the calculation of the rates, ‘eligible’ 
counts are defined as the total number of students selected for interview and 
interviewed’ counts are of eligible students whose records were completed and 



returned. 
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